%0 Journal Article
%4 sid.inpe.br/mtc-m21c/2020/10.07.11.43
%2 sid.inpe.br/mtc-m21c/2020/10.07.11.43.21
%@doi 10.1117/1.JRS.14.036517
%@issn 1931-3195
%T Captive balloon image object detection system using deep learning
%D 2020
%8 Sept.
%9 journal article
%A Velame, Victória Maria Gomes,
%A Bins, Leonardo Sant'Anna,
%A Mura, José Cláudio,
%@affiliation Instituto Nacional de Pesquisas Espaciais (INPE)
%@affiliation Instituto Nacional de Pesquisas Espaciais (INPE)
%@affiliation Instituto Nacional de Pesquisas Espaciais (INPE)
%@electronicmailaddress victoria.velame@inpe.br
%@electronicmailaddress leonardo.bins@inpe.br
%@electronicmailaddress jose.mura@inpe.br
%B Journal of Applied Remote Sensing
%V 14
%N 3
%P e036517
%K deep learning, object detection, remote sensing, captive balloon.
%X The surveillance of large areas to ensure local security requires remote sensors with high temporal and spatial resolution. Captive balloons with infrared and visible sensors, like ALTAVE captive balloon system, can perform a long-term day-night surveillance and provide security of large areas by monitoring people and vehicles, but it is an exhaustive task for a human. In order to provide a more efficient and less arduous monitoring, a deep learning model was trained to detect people and vehicles in images from captive balloons infrared and visible sensors. Two databases containing about 700 images each, one for each sensor, were manually built. Two networks were fine-tuned from a pretrained faster region-based convolution neural network (R-CNN). The network reached accuracies of 87.1% for the infrared network and 86.1% for the visible one. Both networks were able to satisfactorily detect multiple objects in an image with a variety of angles, positions, types (for vehicles), scales, and even with some noise and overlap. Thus a faster R-CNN pretrained only in common RGB (red, green, and blue) images can be fine-tuned to work satisfactorily on visible remote sensing (RS) images and even on the infrared RS images.
%@language en